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ABSTRACT 


competency assessment model for use in special education. teacher : 


Described are various development aspects of-a 


Pp 


training prograss. Probleas (such as differences regarding 
acceptability of existing evaluation procedures) with means and 
criteria for evaluating students are listed. It is noted that a 
competency assessment model should provide for the developrment of 
competency assessment instruments, the collection of student 
performance data, and guidelines for the organization and-analysis of 
resulting data. Competency assessment needs are seen to fall into two 


categories: needs that can best be set or after acquiring data 
including determination of assesssent reZiability\and validity; ‘ 


nd 


needs which can be met prior to acquisition of data, including the. 
development of instruments, procedures, and a data sanagesent systen. 
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Introduc tion ’ 


: mg a 
_ As Joe Gilmore has indicated, in 1972 the New York State Board of: 


Regents mandated hat teacher eennetICn programs become competency based. 


Implicit in- that diet, = later made explicit by the pe Education 


‘pags tant: Division al easher Educ stoi and ele aaa ie was ‘he need 


to specify not only the competencies to be atiained by atudanta; pit the . 


conditions, procedures and criteria pertaining to the assessment of comp~ 


etencies. While teacher cducation’ programs generally. have course outlines _ 


By 


with objectives that can. be tranalated intp competency statements, “examina—" 


tion of means and criteria for evaluating students’ reveals such common 


problems asi ao eae 
Lie subjectivity Ee : . 2 ye i : 
2. lack of instruments : fa : nue :" : ‘ r 
3 Lack of criteria -  , Pe 2s 


eo 4, areas, whore Wittle or no evaluation occurred 


5. differences regarding acceptability gf emnuine ulation procedures 


4a . 
pies «. 


6. varying degtece of explied tnese “pegarding évaluation 


Te dav of a systematic: “way of panaging competency “ssaadbbant and | = 


resulting data ° ey oe ret Mea TNR age 


a, #e ‘ nae ~ 


nt eo aN 


it * Se: ¢ . \ rr ‘ 
.? 8. lack of ‘both’ hymary ‘td material ee to plan and smptenant—_> 


ee Sal sophistinatad asvosenent syutem 


é 
Pu rpose 


; 4 
Because of the abpve. inadequacies, one objective af. the Plattsburgh 


] 


PROCS is to develop resources that may lead to ‘some Saale? mie in .comp- 


etenisy assessment, An initial need involves the planning of an overall 


competency assessment program, The development of a ‘slieeding model seems 
: essential to the Plattsburgh project, and will hopeful Ty: be worth sharing 


with other CBTE programs, 
er A 


Considerations for a. Competency Assessment Model 


Such a model ought to respond to the following concerns: — 
1. It should provide for thé development of competency. assessment 
instruments, 


It ought to provide for ‘the collection of student performance 


data, and of data regarding perceived adequacy of instruments’ on 


and progedures. e i 


, 4 

- It ought- Doni provide ee r the ie saat and anglysis- 

. of resulting data” _ two broad purposes fnvolving evaluation ‘of Ee 
students and evaluation df program, _ 
ae Uses-of data for evaluation of students: 


1. determination of student éompetence in reference ‘to’ 


‘ 


stated criteria. - . 


2. “feedback and advisement for students, 


b.» Uses of data for evaluation of the CBIE program: 


' . 1. 


2, determination of validity + “. 


determination of Se : ‘ 


of dnatenaannin ane procedures 
of student performance over time 


of evaluator judgement ar: P 4 
; ” . . 


. 


© z 
competencies associated with sucegpeful practicum per= — 
formance . as ; J 5" 2 

a \ . < N 5 ‘ 
: crmpeteosige associated with program graduates who’ are 


acintenubant ag effective teachers ; 


cares to which ‘pennontt instruments and seniitieds 


a ° a measure cyan suatsinten . Le oS 
~, ‘ 3. determination. of criteria — =< 7 : . 7 : Pee ar 
: e quantitative porformance acai . A 
ee inial.Atntive perfomance standards - -_ : gee 


iheasared Sotebtonaliow betwetn S aied ablalmant of \ 


criteria and later ti-senviae performance 


‘ ” 


4, interpreting competency, ate : 8 7 : 


ag 4 function af: internal program evaluation and review 


ae support, registration with SED : 4s 


in support of requests for special funding 


os 


. as a) 
. 
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Ld iii a manner in which ‘ad concerns are addressed is also a 


matter of importance 


amase evidence, but ~ soimbdonte this sridangs in meaningful ways to such 


e. The intent of ddwnetency ‘assessment is not uly to ~ 


» tion of hecisidieation beyond ‘the lowal lave calls. for a commonality” of. 


‘ 


Yas 


. 


¥ 


"diverse pabtian: -98 otuiintf, consortia, SED and funding agents... Pacilita- 


teminology and bse 
The Evaluation Training Consortium of ‘< University of Virginia ffers 


_a national: frame of reference. for program evaluation and competency assess 


ment. ‘EITC has.provided training and technical assistance in she use of*, 


, ( 
“the placrepanny Bvaluation Mode] (DEM) to’ Spesal: dination teactiew prep- 


aration bales throughout the country. Moreover, the Division of Per 
sonnel Preparation (BEH) has sponsored and is: intimately familiar with DEM, 
Additionally the DEM is sufficienffY flexible for application to any. - 


, ‘ . 


uniquely local assessment concerns, 


f 


For these reasons the CBTE project at Plattsburgh has adopt the gen- 


eral frame-of-reference of the DEM, 
Table 1 presents a general stmmary of competency assessment considera- 


tions in the DEM fomnat of inputs, processes and outputs. 
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CONSIDERATIONS FOR COMPETENCY ASSESSVENT. 


: = 
~ PROCESSES 
. 
Competencies to be -2s 


Collection of data on: 
a. . Student, performance 

_ b.. assessment instruments; / “? 
c. -assessment protedaures’ 


. Result ts of gata anatysts: 
2. " regarding,iadividual -students 
_ - feedtack on sompetancian a 
Si ig daeoonrg : ns 
academic, advisensnt/- 
” decisions = ae 


3b. Analysis of group data IR y regarding program 
3 : + ,assessment reliability 
- assessment validity 
- competenty validity - 
‘_ qualitative and quaititative 
ae adequacy of criteria . 
- reporting. to: 
SED for registration 
consortium and administra—_ 
tors for program review/ 
mo@ification . + 
in support of proposals - 


Considerations for. Feasibility: | 


Since most teacher preparation programs lack the time and material re- 


‘sources to comprehensively meet, all assessment needs at once, there seems 
Sa 4 ’ » . . 


. to be a need for selectivity. The ordering of, priorities and the acknow- | 


pespentont of limi tations may. help view the overall ‘task with a realistic ; 


fe 


ae dal a : : 


* 
The array of competoney assessment needs seems to fall into two some= 


what overlapping catdgories, In the first acta are ends that can best . 


‘be met only after oes ing data. ede inelude determination of assess— 


ment reliability and validity, ad well ag the specification of adequate cri+ 


teria. The eecond cateyory of .assecsr: rent needs includes those which can be | 


appreciably met prior + ac quisition of data, ‘The aise? needs include 


such matter Oas develop iniz instruments, ‘prpoedures and a data management, 


4 5 e 4 


” 
Regarding ne eds. that can best. be eb? ‘after, , aoqiiring assessment pee 


system. 3 ‘ 


some feasibility eonuiderabtene: are: a se 
ne : F 


1. Te accept best guebe statements of driteria that ean be net within 


the scope ‘of program resourtes, rs 5 
2, To settle for the ednscrtiuns! ct, ‘of construct validity. . 
+ 3. ° To acknowledge tha ipabil tty ta determite reliability without 
; extensive data and sophia td vatod instrumentation, 


A. 4 To view ‘the need for sefentific objectivity as gne which can be 


met in an evolutionary mummies. \ ; ee ek 


5 
Feasibility considerations for resting assessment needs prior to data 
. . . ' r . 
oF ee include: 


1. 


2. 


: to yew early rotdabil tty and valinity data as formative oval: 


program. 


és _." 


fo plan for storage and retrieval of data in a manner that wil) ws 
facilitate the operiet, anowerihg of questions pertaining to’ re=- ’ 
liability and validity’ \a 


tion feedback rather thian as a ountaative jndsamant of adequacy. , 


. ae ‘ Gas a 

‘ es | Ne ; 

Ute teing existing instruments wherever possible, such as tests” 
6 ry 


of académioc knowledge and. pratticum observation ae scales., 


Where competencies have an inhorent davelopmartay sequence, assess ¢. 
— ¢ : 


ment data may be ica only at the end of ‘the ceqience, with’ ine 


‘formal unrecorded assevament oceurring at earlier stages. an ex- ae 


ample of this would be assessing competence in instructiondl plan- 
ning ° : 
Where the need oF instrument development, is overwhelming, efforts 


may fi@cus on a Limited number ‘of: digiintionnten or assessment questions 


_ that are Senevdeded to be of critical importance -to students and. 


Both pe ae and data management. may be simplified if in- 
struments are designed tc assess ae SempeTsonaNes ‘For + 
assessment purposes, coripetencies might be ae ida according to 
the @jine at which they are +o be measured, ‘or ‘according to content 


relatedness. Such clustering should help to reduce the total num 


To-avoid being unnecessarily trapped in data shuffling, a simple si 


. we : 

but adequate student data form is required, It Should have epace ta? f 
eos Le ss ; - os » AY, 

for al data and identification needs to ayoid the regrets of hind ; a 


$i 


sight, but should be easy a students, faculty and cooperating aa 
seifbol perbonnel to understand and use, One such form should suf< ‘ 
: ; y 


i y 
fice for each counge or competency -aluster, - Sumnarization of 


/ } 


group data can-be easily be hafidled by clerical staff if forms for. 
' this purpose aré similar in layout to the individual student prog= 


ress: record, 


Conglus ion' 


’ 
"We. will undoubtedly need-to work long and hard to achieve adequate ," ; 


, ‘understanding and avinbnde) of competence; Qut if we can use CBIE_to im" ct 
a’. : ; ; bree i 
Pes. prove teacher preparation, koi to enhance the education of exceptional child 


2 


H4 “iiren, the effort, will be justified, 
nf + ia: ‘ 
4 


sav 


